Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: pass quote parameter to CSV writer #10671

Merged
merged 1 commit into from
May 26, 2024
Merged

Conversation

DDtKey
Copy link
Contributor

@DDtKey DDtKey commented May 25, 2024

Which issue does this PR close?

Closes #10670

Rationale for this change

What changes are included in this PR?

Are these changes tested?

sqllogictest has been added which fails without these changes

Are there any user-facing changes?

@github-actions github-actions bot added the sqllogictest SQL Logic Tests (.slt) label May 25, 2024
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for this contribution @DDtKey -- the test is especially 👨‍🍳 👌

(3, 'g|g|g'),
(4, 'h|h|h');

# quote is required because `|` is delimiter and part of the data
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I double checked the contents of the file look good

andrewlamb@Andrews-MacBook-Pro-2:~/Software/datafusion$ cat ./datafusion/sqllogictest/test_files/scratch/csv_files/table_with_necessary_quoting.csv
int_col|string_col
1|~e|e|e~
2|~f|f|f~
3|~g|g|g~
4|~h|h|h~

@alamb alamb merged commit c095fee into apache:main May 26, 2024
23 checks passed
jayzhan211 pushed a commit to jayzhan211/datafusion that referenced this pull request May 26, 2024
svranesevic pushed a commit to coralogix/arrow-datafusion that referenced this pull request Jun 8, 2024
findepi pushed a commit to findepi/datafusion that referenced this pull request Jul 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
sqllogictest SQL Logic Tests (.slt)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CSV quote parameter is ignored
2 participants